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.The main point I will try to make this morning is that » 
individualized instruction has different effects on different people. 
Specifically, I will argue that it has different effects on elementary 
achool, secondary school, and college-levfel learners, I will be 
arguing therefore for the existence of an Aptitude-by-Treatment 
interaction involving the developmental level of the learner and the 
degree of Indtvidualizitfon, Before I presen%yny argtiment and the 
evidence f9r it, however, I want to make some genecal points about 
Aptitude-by-Treatment interactions in education. 



CronbaGh's Contribution 

I believe that Cronbach's caliper a science of Aptitude-by 
Treatment interactions (or ATIs) in 1957 was one of the most exciting 
challenges made to psychology and -education in recent ye^s. In his 
1957 address, Cronbach contended that behavioral researchers were 
split into two opposing camps by two opposing" -traditions. One 
tradition was basically aristocratic and conservative, and emphasized 
the 'Stable differences among people. This was the measurement or 
psychometric tradition that traced its lineage back to nineteenth 
century Britain and to the contributions of Francis Galton, A second 
tradition was more democratic and optimistic, and emphasized the 
malleability of people ai^ their capacity to profit from experience* 
This was the tradition of behaviorism dfveloped in America u^Ser the 
leadership of Edward Thorndike and John"Vatson, Cronbach jfeld that 
the split jDetween the correlator's and the manipulators impeded 
scientific research. 

The type of study that was to heal the split combined the 
correlating and the manipulating approaches. The typical study wa3 a 
two-group experiment in which aptitude was measured for each, subject 
in each group. An ATI existed when one treatment was not equally 
superior (or inferior) to another treatment all long the aptitude 
scale. Treatment A, for example, might help students of high ability 
quite a bit, but might be no better than Treatment B, f or students of 
.low ability. The signal that an ATI existed uas^ difference in the 
regression of outcome on aptitude for the tw/5 groups. 

In the 60's and 70's, the potential^f this type of experiment 
seeaed great for both educational research and practice, but today it 
is a commonplace observation that the»yiej.d, of ATI studies has ,been 
disappointing in several ways: / 

—First, it would be nice if ATI studies replicated, but ATIs found 
- in one-setting rirely turn up in other settings. The lack of ' 

replicated ATIs has been on^ of* the biggest single 

disappointments in the ATI literature, 

— Second, it would be nice to have speoifiG abilities consistently 
involved in ATIs. That wobld add greatly to our theoretical 
knowledge of ability. But ATIs, when they are found, often 
involve general a^itude. Theoretically stimulating findings 
have been the exemption rather than the rule in ATI research. 
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— Third, it is now also clear that early ideas about ATIs were also 
simplistic from a pedagogical point of view. Suppose' that 
nonvisualizers do not learn well from diagrams, while visualizers 
do. Should we therefore condemn nonvisualizers forever to prose 
explanations? Perhaps nonvisualizers heed more work, rather than 
less, with diagrams. Educators have been protected from thinking 
through the pedagogical implications of ATIs only because ATIs 
have been so rarely confirmed. ( 



Glasses ADProaoh 

Let me turn nbw to Glass's '(1^76) work an meta-analysis. This 
work was not originally designed fto shed light on ATIs. Glass's 
concern was simply to find a way to make sense of the rapidly growing 
literature of eduction and psychology. His solution was toi treat 
study results as though they were raw data from an experiment. He 
used systematic methods to collect stud^jes; he used objective 
•techniques to quantify variables; and he used statistical methods to 
analyze the collected results. 
♦ 

A careful look at the conclusions /rom meta-analysis shows that 
they sometimes involve ATIs. Me'ta-anarfytic conclusions tend to be of 
two types. The first type of conclusion is about overall or main 
effects—the average effect of a treatment, in a set of studies. 'The *, 
other conclusions from meta-analysis are about interaction effects — 
the special conditions that modify the general conclusions. Thus, 
Glass tried to determine not only how effective psychotherapy was in 
general, but also whether psychotherapy was especially\ef ^ective in 
studies of certain types of patients. When meta-analysis establishes, 
special effectiveness for a method in studies of a certain type t)f 
person, meta-analysis is~in effect — positing an ATI. 

I believe that in the long run we will learn a good deal about 
ATIs from meta-analysis. That is,* to find out which treatments are 
most effective* i^or, which people, we should not only look within 
studies (as Cronbach does), we should also look across collections of 
studies (as Glass has done). If we use this strategy, I think that we 
will overcome the shortcomiii^s.,of traditional ATI research. First, 
we^i;. get consistent results; second, we'll get stimulating results; 
^jad" thircf, we'll get results that we can use. ♦ 

Results 

First, let me >s^ something about the consistency of results from 
meta-analysis. This symposium 'gives us a rire opportunity to check on 
the' consistency of meta-arialytic findings because Its analyses overlap 
in part with analyses carried .out a few years ago by Susan H^tleyV 
one of Glasa's students. In 1977 Hartley wrote her dissertation ' 
reporting on meta-analytic findings on individually paced instruction 
in jnathematics. Included in her results were findings on tutoring 
programs and programmed instruction. Although pete Cohen's (1981) and 
Barb Ebeling's (1981) analyses covere(? more than mathematics 
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instruction, it is possible to look separately at thdir results from 
the area of mathematics, and to check these results against Hartley^-s. 



I Insert Figure 1 about here j 

H . ^ 

This figure includes results from the University of Michigan and 
from the University of Colorado (>n the 'effects of tutoring and 
programmed instruction on ^mathematics achievement. Both thp Michigan 
and Colorado meta-analyses found that tutoring raised mathematics 
achievement by .60 standard-deviation-units in elementary and 
secondary schools. The Colorado meta-analysis reported that 
programmed instruction boosted mathematics achievement by .01 
^standard-deviation-units, while the Michigan study found that it < 
-decreased mathematics achievement by this amount. I'm impressed by 
this consistency in results., 



Insert Figure 2 about here j 



There is also consistency in the kinds^ of interactions being 
reported by 'different investigators. Three' independent meta-analyses 
have concluded that programmed instruction has Ijeen producing better 
results indecent years than it did in earlier years. This figure 
shows results from Hartley's meta-analysis at the University of 
Colorado, and two of our meta-analyses at Michigan. The time trend in 
results from'^ programmed instruction 'was a major finding in each of 
these meta-analyses, and it is a trend ,that is holding up beautifully 
as more data are coming in.. 
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Insert Figure 3 about here 



This figure provides my final example of the consistency in 
results from meta-analytic studies. Each of the presenters this 
morning reported tbat findings published in journal articles were 
stronger and more positive than findings from dissertations. For the 
three meta-analyses described this morning, the average effect 
reported in journal articles was .16 standard-deviation-units higher 
than the average effect reported in dissertations. In a chapter in a 
volume edited by Herbert Walberg, Mary Lee Smith (1980) recently 
summarized findings on this question from University of Colorado 
studies. Each of 12 Colorado meta-analyses reported that effects in 
journals' were stronger than those in dissertations. In the 12 
studies, the average journal effect was .16 standard-deviation-units 
higher than the^erage dissertation effect—the same as our result at 
"Michigan. 

A seoond point that I want to make is that meta-analytic findings 
will often be stimulating because they are based on a wide variety of 
settings, ages, and groups. To make the point, I will present some 
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composite'results, based on studies from both Michigan and Colorado, 
on the effecPts of indlvidualizatioti at different age levels. The 
results are restricted to aathemat4.cs education because that is the 
only area where meta-analytic studies cover the whole age range-- from 
K tlfrough college. 

+ 

' . ! Insjert Figure 4 about here | 



The first figure shows Ihe effects of computer-based 
individualization on mathematics achievement at different educational 
levels, I think that the trend is cleau*. In the elementary schools, 
individualization^ has positive effects. Computer drill-and-practice 
in arithmetic apparently keeps children interested and actively 
responding; it provides them with immediate feedback on their answers; 
^it guides them from one kind of problem to another. Students a^ld 
tasks are different at the secondary school level, however, and the 
relative advantage of the computer begins to fall off. Finally, at 
the college level, wljere .students are selected for their ability ^d 
motivation, computers apparently offer little beyond what can be 
provided by a teacher, a book, and ^ paper |^ pencils. 



Insert Figure 5 about here 1 



'Meta-analytic findings are quite different for self-paced unit 
approaches to teaching. Methods like 1^1,-PLAN, and Keller's PSI 
first divide the subject matter of a class into units thmtf typically 
ccver about a chapter of a textbook or about a week's woW. Students 
.use learnio^ activity packages t# Bister the objectives for a unit, 
and then must demonstrate their i^stery of objectives on r^peatable 
quizzes. The meta-analytic results suggest that college students 
often have the maturity to work uAd?r the conditions that these 
systems provide. College students apparently profit from forking 
themselves for a week or so before receiving an individual evaluation 
and a prescription for further work." For elementary school students, 
on the other hand, the systems developed so far may provide too little 
support. Elemenj^rt school pupils may need more feedback, mdre 
individual contact, and more guidance than these self-pace4 systems 
provide. At this level,' computers may be a better investment. 

« 

- '^e final point that I want to make is that ATI findings such as 
t^xOTe I've reviewed from meta-analytic reseai^ch seem to have 
implications for practice. What meta-analysis has showh is that 
computers and individualized systems have compiled especially strong 
records in some of the settings where they have been introduced, and 
have weaker records in o'ther areas. I'would encourage more vigorous 
development of these approaches in the areas where they seem to be- 
making ^e. most substantial .contributions. 

^^et me summari2;iB the points that I have made and the conclusions 
that I have drawn: » 



/(I) I pointed out that the type of study proposed by Cronbach 
for, investigating ATI^ has .proved to be disappointirl^ in 
several refepects. This type of study produces ATIs that do 
not^ replicate, tha^t are ndt especially interesting,, and that 
are difficult to Use in practice. " - 

<2) I pointed out thit Glad&^s^j^eta-analytic methodology, 

although djevelopted for different purpose, sometimes yields 
. information abo^t ATIs— about which treatments are 
especially effective for certain types of uiarners. , 

(3). I recommended that Glass's methodology be used more as a 
means of investigating ^TIs/ Results produced by mete- 
analxsls so f^ seem to be replicable. They seem to me to 
be stimulating from the standpoint of instructional theory. 
And they sometimes have clear implications for practice. 
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